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IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 

METHOD 

Claim of priority 

[1] This application claims priority to U.S. Provisbnal AppticatJon Serial 

No. 60/422,603, filed on October 31, 2002» which is incorporated by reference. 

Cross reference to related APPLtCATioNS 

|2| This application is reSated to U.S, Patent App. Serial Nos. 10/684,053 

entitled COyPUTlNG MACHINE HAVING IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD; 10/683,929 entitled 
PIPELINE ACCELERATOR FOR IMPROVED COMPUTING ARCHfTEGTURE AND 
RELATED SYSTEM AND METHOD; 10/684,057 entitied PROGRAMMABLE 
CIRCUIT AND RELATED COMPUTING MACHINE AND METHOD; and 10/683,932 
entitled PiPEUNE ACCELERATOR HAVING MULTIPLE PIPELINE UNITS AND 
RELATED COMPUTING MACHINE AND METHOD; at! filed on Octobers, 2003, 
and having a common owner, and v^ich are incorporated by reference. 

BACKGROUND 

li} A comnnon computing architecture for processing refatively lai^e 

amounts of data in a refativeiy short period of time includes muitipie interconnected 
processors that share the processing burden. By sharing the processing burden, 
these multiple processors can often process the data more quickly than a single 
processor can for a given clock f requency. For example, each of the processors can 
process a respective portion of the data or execute a respective portion of a 
processing algorithm. 

[4| FIG. 1 is a schematic bfock diagram of a conventiona! computing 

machine 10 having a muSti-processor architecture. The machine 10 includes a 
master processor 12 and coprocessors 14i - 14^, which communicate with each 
other and the master processor via a bus 16, an input port 18 for receiving raw data 
from a remote device (not shown in FIG. 1), and an output port 20 for providSng 
processed data to the remote source. The machine 10 also includes a memory 22 
for the master processor 12, respective memories Mi - 24n for the coprocessors 14i 
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- 14n, and a memory 26 that the master processor and coprocessors share via the 
bus 16. The memory 22 serves as both a program and a working memory for the 
master processor 12, and each memory 24f - 24^ serves as both a program and a 
working memory for a respective coprocessor 14^ - 14^. The shared memory 26 
alfowa the master processor 12 and the coprocessors 14 to transfer data among 
themsefves, and from/to the remote device via the ports 1B and 20, respectively. 
The master processor f 2 and the coprocessors 14 afso receive a common clock 
signal that controls the speed at which the machine 10 processes the raw data, 

|S3 In general, the computing machme 10 etfectiveiy dMdes the 

processing of raw data among the master processor 12 and the coprocessors 14. 
The remote source (not shown In FIG, 1) such as a sonar array (FIG. 5) toads the 
raw data via the port IB into a section of the shared memory 26, which acts as a 
first«in-first-out (F!FO) buffer (not shown) for the raw data. The master processor 12 
retrieves the raw data from the memory 26 via the bus 16, and then the master 
processor and the coprocessors 14 process the raw data, transferring data among 
themselves as necessary via the bus 16. The master processor 12 loads the 
processed data into another FIFO buffer (not shown) defined in the shared memory 
26, and the remote source retneves the processed data from this FIFO via the port 
20. 

[63 in an example of operation, the computing machine 10 processes the 

raw data by sequentially performing n 1 respective operations on the raw data, 
where these operations together compose a processing algorithm such as a Fast 
Fourier Transform (FFT). More specifically, the machme fO forms a data-processing 
pipeline from the master processor 12 and the coprocessors 14. For a given 
frequency of the clock signal, such a pipeilne often allows the machine 10 to process 
the raw data faster than a machine having only a singie processor. 

[71 After retrieving the raw data from the raw-data FIFO (not shown) in the 

memory 26, the master processor 12 performs a first operation, such as a 
trigonometric function, on the raw data. This operation yields a first result, which the 
processor f 2 stores in a first-result FIFO (not shown) defined within the memory 26. 
Typically, the processor 12 executes a program stored in the memory 22, and 
performs the above-described actions under the contfoi of the program. The 
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processor 12 may also use the memory 22 as working memory to temporarily store 
data that the processor generates at intermediate intervals of the first operation. 

|8] Next, after relrfeving the first result from the first-result FIFO (not 

shown) in the memory 26, the coprocesaor 14i performs a second operation^ such 
as a logarithmic function, on the first result. This second operation yields a second 
result, which the coprocessor 14i stores In a second«result FIFO {not shown) defined 
within the memory 26. Typically, the coprocessor 14i executes a program stored in 
the memory 24f , and performs the above-described actions under the control of the 
program- The coprocessor 14i may also use the memory 24f as woilcSng memory to 
temporarily store data that the coprocessor generates at intermediate intervals of the 
second operation, 

[9] Then, the coprocessors 24^ - 24n saquentiafly perform third - n^^' 

operations on the second {n-if' results in a manner similar to that discussed 
above for the coprocessor 24f, 

[10] The n^ operation, which is performed by the coprocessor 24^, yields 

the fjnai resuit, Lb., the processed data. The coprocessor 24^ loads the processed 
data into a processed-data FIFO (not shown) defined within the memory 26, and the 
remote device (not shown in FIG. 1) retneves the processed data from this FIFO. 

[11] Because the master processor t2 and Goprocessors 14 are 

simyltaneousjy perfbrming different operations of the processing aigorithm, the 
computing machine 10 is often able to process the raw data faster than a computing 
machine having a single processor that sequentialiy performs the different 
operations. SpeciflcaHy, the single processor cannot retrieve a new set of the raw 
data until it performs ail n + 1 operations on the previous set of raw data. But using 
the pipeline technique discussed above, the master processor 12 can retrieve a new 
set of raw data after performing only the first operation. Consequently, for a given 
cioci< frequency, this pipeline technique can increase the speed at which the 
machine 10 processes the raw data by a factor of approximately n 1 as compared 
to a sfngle-processor machine (not shown in FIG* 1)* 

[123 Alternatively, the compyting machme 10 may process the raw data in 

paralte! by simultaneously performing n + 1 instances of a processing algorithm. 
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such as an FFT» on the raw data. That is, if the algorithm incfudes n + l sequentia! 
operations as descfibed above In the previous example, then each of the master 

processor 12 and the coprocessors 14 sequential iy perform all i operations on 
respective sets of the raw data. Consequently, for a given clock frequency, this 
parayel-processing technique, like the above-described pipeline technique, can 
increase the speed at which the machine 10 processas the raw data by a factor of 
approximately n 1 as compared to a single-processor machine {not shown in FIG. 

[13] Unfortunately, although the computing machine 10 can process data 

more quickly than a sjng!e*processor computer machine (not shown in FiG. 1), the 
data-processing speed of the machine 10 m often significantly less than the 
frequency of the processor clock. Speofflcalty, the data-processing speed of the 
computing machine 10 is limited by the time that the master processor 12 and 
coprocessors 14 mquke to process data. For brevity, an example of this speed 
fimitation is discussed in conjunction with the master processor 12, although it is 
understood that this discussion also applies to the coprocessors 14. As discyssed 
above, the master processor 12 exaeutes a program that controls the processor to 
manipuiate data in a desired manner. This program inciudes a sequence of 
Instructions that the processor 12 executes. Unfortunately, the processor 12 
typlcaily requires multiple clock cycles to execute a single instruction, and often must 
execute multiple instnjctions to process a single value of data. For example, 
suppose that the processor 12 is to multiply a first data value A (not shown) by a 
second data value B (not shown). During a first dock cycle, the processor 12 
retrieves a multiply instniction from the memory 22. During second and third ctook 
cycles, the processor 12 respectively retrieves A and B from the memory 26. During 
a fourth clock cycle, the processor 12 multiplies A and B, and> during a fifth clock 
cycle, stores the resulfing product In the memory 22 or 26 or provides the resulting 
product to the remote device (not shown). This is a best-case scenario, because in 
many cases the processor 12 requires additional oSock cycles for overhead tasks 
such as initiaiizing and closing counters. Therefore, at best the processor 12 
requires five clock cycles, or an average of 2.5 dock cycles per data value, to 
process A and B,. 
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[14] Consequentiy, the speed at which the computing machine 10 

processas data Is often significantly lower than the frequency of the clock that drives 

the master processor f2 and the CDprocessors 14. For exampie, if the processor 12 
is clocked at 1 .0 Gigahertz (GHz) but requires an average of 2.5 ctock cycles per 
data value, than the effective data-processing speed equals (1.0 GHz)/2.5 - OA 
GHz. This effective data-processing speed \s often characterized in units of 
operations per second. Therefore, in this exaropiej for a dock speed of 1 .0 GHz, the 
processor f 2 would be rated with a data-processing speed of 0.4 
Grgaoperations/second (Gops), 

[151 FIG. 2 is a block diagram of a hardwired data pipeline 30 that can 

typically process data faster than a processor can for a given clock frequency, and 
often at substantiaBy the same rate at which the pipeline is clocked* The pipeline 30 
includes operator circuits 32i - 32„ that each perform a mspective operation on 

respective data without executing program instructions. That is, the desired 
operation is "burned in" to a circuit 32 such that it impiements the operation 
automatically, v^ithout the need of program instryctions. By eiiminating the overhead 
associated with executing program instructions, the pipeline 30 can typicaify perform 
more operations par second than a processor can for a given clock frequency, 

[16] For example, the pipeline 30 can often solve the following equation 

faster than a processor can for a given clock frequency: 

(1) Y{x,)-{5x,^3)2^ 

where xh represents a sequence of raw data vaiues. In this example, the operator 
circuit 32i is a muftiplier that calculates 5xk, the circuit 32z is an adder that calculates 
5Xk 3, and the circuit 32^ (n 3) is a multiplier that calcuiates (5xk + 3)2^\ 

[1 7] During a first dock cyde k^i , the circuit 32i receives data value xi and 

multipHes it by 5 to generate 5xi. 

[1 8] During a second clock cycle k ~ 2, the circutt 32^ receives 5xi from the 

circuit 32i and adds 3 to generate 5xi ^ 3. Also, during the second clock cycle, the 
circuit 32i generates 5X2- 

^^^^ [193 During a third clock cycle k 3, the circuit 32^ receives 5xi ^ 3 

from the circuit 325 and multiplies by 2'"^^ (effectively right shifts 5xi 3 by Xi) to 
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generate the first result {5xt + 3)2^% Also during the third ciock cycle, the circuit 32t 
generates 6X3 and the circuit 322 generates 6x3 + 3, 

[20] The pipeline 30 continues processing subsequent raw data values Xk in 

this manner unttt aH the raw data values are processed. 

[213 Consequentty, a delay of two cfock cycles after receiving a raw data 

value xt ~ this delay is often calfed the iatency of the pipeline 30 — the pipeline 
generates the result (5xi + 3)2^\ and thereafter generates one result each clock 
cycie, 

[22| Disregarding the iatency, the pipefine 30 thus has a data-processing 

Speed equal to the clock speed. In comparison, assuming that the master processor 
12 and coprocessors 14 (FIG. 1) have data-processing speeds that are 0,4 times the 
ciock speed as in the above example, the pipeline 30 can process data 2.5 times 
faster than the computing machine f 0 (FIG. 1) for a given dock speed. 

[233 Stii! referring to FIG, 2, a designer may choose to implement the 

pipeline 30 m a programmable logic !C (PL!C), such as a fieid-programmabie gate 
array (FPGA), because a PLiC aifows more design and modification flexiblfity than 
does an application spedfic IC (ASIC). To configure the hardwired connections 
within a PLiC, the designer merely sets interconneotion-configy ration registers 
disposed within the PLIC to predetermined binary slates. The combination erf all 
these binary states is often called Tirmware." TypicaOy, the designer loads this 
firmware into a nonvolatile memory (not shov^n in FIG* 2) that is coupled to the PLIC. 
When one "turns 00" the PLIC, it downloads the firmware from the memory into the 
interconnection-configuration registers. Therefore, to modify the functioning of the 
PLIC, the designer merely modifies the firmware and allov^^s the PLIC to download 
the modified firmware into the interconr^ection-configuratton registers. This ability to 
modify the PLiC by merely modifying the firmware is particularly useful during the 
prototyping stage and for upgrading the pipeline 30 "in the field". 

124} Unfortunately, the hardwired pipeilne 30 typically cannot execute ail 

algorithms, particuiariy those that entai! significant decision making, A processor can 
typically execute a dedsion-making instruction {e.g., conditional instructions such as 
"if A, then go to B, else go to C") approximately as fast as it can execute an 
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Operational instruction (e.g., "A + B*) of comparabie length. But aithough the pipeline 
30 may be able to make a refativefy simpie decision (ag., **A > B?"), ft typicaliy 
cannot execute a relatively compiex decision (e.g., "if A, then go to B, else go to C")- 
And although one may be able to design the pipeHne 30 to execute such a complex 
decision, the size and complexity of the required circuitry often makes such a design 
impractical, particutarly where an afgorithm includes multipfe different compiex 
decisions, 

[25] Consequently, processors are typically used in appiications that require 

significant decision making, and hardwired pipelines are typically limited to "number 
crunching" applications that entai! tittle or no decision making. 

[26| Furthermore, as discussed batow, it is typically much easier for one to 

design/modify a processor-based computing machine, such as the computing 
machine 10 of FIG. 1, than it is to design/modify a hardwired pipeline such as the 
pipeline 30 of FIG, 2, particularly where the pipeline 30 inciudes multiple PLICs. 

127} Computing components, such as processors and their peripherals 

{e.g., memory), typically include industry-standard communication interfaces that 
facilitate the interconnection of the components to form a proGessor-based 
computing machine, 

[283 Typicaiiy, a standard communication interface Includes two layers: a 

physical iayer and an service layer, 

[29| The physical layer includes the ciroiitry and the corresponding circuit 

interconnections that forni the interface and the operating parameters of this 
circuitry. For example, the physical layer inciudes the pins that connect the 
component to a bus, the buffers that latch data received from the pins, and the 
drivers that drive data onto the pins. The operating parameters include the 
acceptable voltage range of the data signals that the pins receive, the signal timing 
for writing and reading data, and the supported modes of operation (e.g., burst 
mode, page mode), Conventtonai physical tayers inctude transistor-transistor logic 
{TTL) and RAySUS, 

[30] The service layer includes the protocoJ by which a computing 

component transfers data. The protocol defines the format of the data and the 
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manner in which the component sends and receives the formatted data. 
Conventional communication protocols include file-transfer protocol (FTP) and 
TCP/IP (oxpand). 

£31] Consequently, because manufacturers and others typicaliy design 

computing components having industry-standard communication layers, one can 
typically design the interface of such a component and interconnect it to other 
computing components with relatively little effort. This aliows one to devote most of 
his time to the designing the other portions of the computing machine, and to easily 
modify the machine by adding or removing components. 

[32] Designing a computing component that supports an industry-standard 

communication layer allows one to save design time by using an existing 
physical-layer design from a design library. This also insures that he/she can easily 
interface the component to off-the-shelf Gomputing components. 

£333 And designing a computing machine using computing components that 

support a common industry-standard communication iayer allows the designer to 
interconnect the components with little time and effort- Because the components 
support a common interface iayer, the designer can interconnect them via a system 
bus with little design effort* And because the supported intefface layer is an industry 
standard, one can easily modify the machine. For example, one can add different 
components and paripherais to the machine as the system design evolves, or can 
easily add/design next-generation components as the technoiogy evolves. 
Furthermore, because the components support a common industry-standard service 
layer, one can incorporate into the computing machine's software an existing 
software moduie that impiements the corresponding protocoi. Therefore, one can 
interface the components with littte effort because the interface design is essentlaHy 
already in pface, and thus can focus on designing the portions {e.g., software) of the 
machine that cause the machine to perform the desired function{s). 

[343 Sut unfortunately, there are no known industry-standard 

communication iayers for components, such as PLICs, used to form hardwired 
pipelines such as the pipeline 30 of FIG* 2. 
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[35] Consequently, to design a plpaline having multip!e PLiCs, one typically 

spends a significant amount of time and exerts a significant effort designing and 
debugging the communication layer between the PLlCs 'from scratch/' Typically, 
such an ad hoc communicatton iayer depends on the parameters of the data being 
transferred between the PLlCs. Likewise, to design a pipeline that interfaces to a 
processor, one would have to spend a significant amount of time and exert a 
significant effort in designing and debugging the communication layer between the 
pipeline and the processor from scratch, 

[36] Similariy, to modify such a pipeline by adding a PLiC to it one typicaBy 

spends a significant amount of time and exerts a significant effort designing and 
debugging the communication layer between the added PLiC and the existing 
PLlCs. Likewise, to modify a pipeline by adding a processor, or to modify a 
computing machine by adding a pipeline, one wouid have to spend a signiUcant 
amount of time and exert a significant effort in designing and debugging the 
communication layer between the pipeline and processor, 

[37] Consequentiy, referring to FIGS, 1 and 2, because of the difficuities in 

interfacing multipie PLiCs and in interfacing a processor to a pipeline, one is often 
forced to make significant tradeoffs when designing a compyting machine. For 
example, with a processor*based computing machine, one is forced to trade number- 
cmnching speed for complex decision-making ability and design/modifjcation 
flexibility. Conversely, with a hardwired pipeline-based computing machine, one is 
forced to trade compiex-decislon-making ability and design/modification flexibility for 
numberK:runching speed. Furthermore, because of the difficulties in interfacing 
multiple PLiCs, it is often impractioai for one to design a pipeline-based machine 
having more than a few PLlCs. As a rasuit a practioa! pipetine-based machine often 
has limited IlinctionaSity. And because of the difficulties in interfacing a processor to 
a PLiC, it would be Impracticai to interface a processor to more than one PLiC. As a 
rasuit, the benefits obtained by combining a prooassor and a pipeline would be 
minimal, 

[38] Therefore, a need has arisen for a new computer architecture that 

allows one to combine the decision-making ability of a processor-based machine 
with the number-crunching speed of a hardwired-pipeiine-based machine. 

9 
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BUfAUARY 

[39] In an embodiment of the invention, a peer»vector machine inciudes a 

host processor and a hardwired pipeline accelerator. The host processor exacutes a 
program, and, in response to the program, generates host data, and the pipeline 
accelerator generates pipeline data from the host data, 

[40| According to another embodiment of the invention, the pipeline 

accelerator generates the pipafine datet, and the host processor generates the host 
data from the pipeline data, 

[41 1 Because the peer-vector machine includas both a processor and a 

hardwired pipeline accelerator, it can often process data more efficiently than a 
computing machine that inciudes only processors or only hardwired pipelines. For 
example, one can design the peer vector machine so that the host processor 
perfomis decision-making and non-mathematioally Intensive operations while the 
accelerator performs mathemattcaily intensive operations. By shifb'ng the 
mathematically intensive operations to the accelerator, the peer^vector machine 
often can, for a given clock frequency, process data at a speed that surpasses the 
speed at which a processor*only machine can process the data. 

Brief DESCRiPTiota of the Drawings 

[42] FIG. 1 is a block diagram of a computing machine having a 

conventionai multi-processor architecture* 

[43] FIG. 2 is a block diagram of a conventional hardwired pipelhe. 

[44] FIG. 3 is schematic block diagram of a computing machine having a 

peer-vector architectjre according to an embodiment of the invention. 

[45] FIG. 4 is a schematic block diagram of an electronic system that 

incorporates the peer-vector computing machine of FIG. 3 according to an 
embodiment of the Invention. 

Detailed Descriptiom 

[46] FtG. 3 is a schematic block diagram of a computing machine 40, which 

has a peer-vector archftecture according to an embodiment of the invention. In 
addition to a host processor 42, the peer-vector machine 40 inciudes a pipeline 
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accelerator 44, which performs at least a portion of the data processing, and which 
thus effectively replaces the bank of coprocessors 14 In the computing machine 10 
of FIG. 1 . Therefore, the host-processor 42 and the aoceierator 44 are "peers'" that 
can transfer data veolors back and forth. Because the accelerator 44 does not 
execute progrann instructions^ it typicaiiy performs mathemattcaHy intensive 
operations on data significantly faster than a bank of coprocessors can for a given 
clock frequency. Consequently, by combing the decisbn-making abiSity of the 
processor 42 and the number-crunching ability of the accelerator 44, the machine 40 
has the same abilities as, but can often process data faster than, a conventional 
computing machine such as the machine 10. Furthemiore, as discussed in 
previously cited U.S, Patent App. Sena! Nos. 10/684,053 entitled COMPUTING 
MACHINE HAViNG IMPROVED COyPUTING ARCHITECTURE AND RELATED 
SYSTEM AND METHOD and 10/683,929 entitled PIPEUNE ACCELERATOR FOR 
IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
iVtETHOD, providing the accelerator 44 with the same communication layer as the 
host processor 42 facilitates the design and modification of the machine 40, 
particutarly where the communications layer is an industry standard. And where the 
accelerator 44 Indudes multiple components (e.g., PLICs), providing these 
components with this same oommunicatlon iayer faciiitates the design and 
modification of the accaterator, particularly where the communiGation layer is an 
industry^ standard. Moreover, the machine 40 may b\so provide other advantages as 
described beiow and io the previously cited patent appljcations. 

147} In addition to the host processor 42 and the pipeline accelerator 44, the 

peer-vector computing machine 40 includes a processor memory 46, an interface 
memory 48, a bus SO, a firmware memory 52, optional raw-data input ports S4 and 
56, processed-data output ports 58 and 60, and an optfonai router 61. 

[48| The host processor 42 includes a processing unit 62 and a message 

handler 64, and the processor memory 46 includes a processing-unit memory 66 
and a handler memory 68, which respectively serve as both program and working 
memories for the processor unit and the message handier. The processor memory 
46 also inciudes an aGceierator-configy ration registry 70 and a 
message-configuration registry 72, which store respective configuration data that 

11 
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ailow the host processor 42 to configure the functioning of the acceterator 44 and the 
struGtyre of the messages that the message handler 64 generates, 

[493 The pipeime acceterator 44 is disposed on at least one PUG (not 

shown) and includes hardwired pipeiines 74t - 74«, which process respective data 
without executing program instructions. The firmware memory 52 stores the 
configuration firmware for the accelerator 44. If the acceferator 44 is disposed on 
multipie PLiCs, these PLtCa and their respective f innware memories may be 
disposed on multiple circuit boards, /,a, daughter cards (not shown). The 
accelerator 44 and daughter cards are discussed further In prevfousiy cited U-S- 
Patent App> Serial Nos. 10/683,929 entitled PIPELINE ACCELERATOR FOR 
IMPROVED COMPUTING ARCHiTECTURE AND RELATED SYSTEM AND 
METHOD and 10/683,932 entitled PIPELINE ACCELERATOR HAVING MULTIPLE 
PIPELINE UNITS AND RELATED COyPUTiHG MACHINE AND yETHOD, 
Alternatively, the accelerator 44 may be disposed on at ieast one ASIC, and thus 
may have interna! interconnectlor^s that are uncDnfigurabia. !n this aiternative, the 
machine 40 may omit the firmware memory 52. Furthermore, although the 
accelerator 44 is shown Induding multiple pipeiines 74^ it may include only a single 
pipeline. 

j[SOJ Stiil referring to FIG. 3, the operation of the peer-vector machine 40 is 

discussed below accoi^lng to an embodiment of the Invention. 

Conflaurina the Peer-Vector tVlachme 

[51] When the peer-vector machine 40 is first activated, the processing unit 

62 configures the message handler 64 and the pipeiine accelerator 44 (where the 
accelerator is configurable) so that the machine will execute the desired algorithm. 
Specifically, the pn^cessing unit 62 executes a host application program that is 
stored in the memory 66 and that causes the processing unit to configure the 
message handler 64 and the accelerator 44 as discussed below. 

[523 To configure the message handler 64, the processing unit 62 retrieves 

message-format information from the registry 72 and provides this format information 
to the message handSen which stores this infomiation in the memory 60. When the 
machine 40 processes data as discussed below, the message handler 64 uses this 
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format information to generate and decipher data messages that have a desired 
format In one embodiment, the fomiat Information is written in Extensibie Markyp 

Language (XML), although it can be written in another language or data format 
Because the processing unit 62 configures the message handler 64 each time the 
peer-vector machine 40 Is activated, one can modify the message format merely by 
modifying the fonnat information stored in the registry 72, Alternatively, an external 
message-configy ration library (not shown) can store information for multiple 
message formats, and one can design and/or modify the host appiication so that the 
processing unit 62 updates the registry 72 from selected parts of the library, and then 
downloads the desired format information from the updated registry to the message 
handler 64. The message format and the generating and deciphering of messages 
are further discussed below and in previously cited U,S, Patent App, Serial Ho. 
10/684,053 entitled COMPUTING MACHINE HAVING iMPROVED COMPUTING 
ARCHiTECTURE AND RELATED SYSTEM AND METHOD. 

|533 SimitarJy, to configure the interconnection layout of the pipeHne 

accelerator 44, the processing unit 62 retrieves configuration firmware from the 
registry 70 and downloads this firmware to the memory 52 via the message handler 
64 and the bus 50. The accelerator 44 then configures itself by downloading the 
firmware from the memory 52 into its fntarconnectbn-configuration registers (not 
shown). Because the processing unit 62 configures the acceieiBtor 44 each time the 
peer-vector machine 40 is activated, one can modify the interconnection-layout — 
and thus the fyncfioniog — of the acceierator 44 merely by modifying the firmware 
stored In the registry 70. Alternatively, an external acceierator-^conflguration library 
{not shown) can store firmware for multiple configurations of the accelerator 44, and 
one can design and/or modify the host application so that the processing unit 62 
updates the registry 70 from selected parts of the library, and then downloads the 
desired firmware from the updated registry to the memory 52. [Furthermore, the 
external library or the registry 70 may store firmware moduies that define different 
portions and/or functions of the accelerator 44.| Therefore, one can use these 
modules to facilitate the design and/or modification of the acceierator 44, In addition, 
the processing unit 62 may use these modules to modify the acceterator 44 while the 
machine 40 is processing data. The intarconnection-confjguration of the accelerator 
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44 and the firmware modules are discussed further In previously cited U.S. Patent 
App, Serial No^ 10/684,057 entitted PROGRAMMABLE CIRCUIT AND RELATED 
COMPUTING yACHINE AND METHOD. 

[541 The processing ynit 62 may also "soft configure" the pipeline 

accelerator 44 white the peer-vector machine 40 is processing data* That is, the 
processing unit 62 may configure the functioning of the acceterator 44 without 
attering the acce!erator's interconnection iayout Such soft configuration is 
discussed further below and in U-S. Patent App. Senaf No, 10/683,929 entitfed 
PIPELINE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD, 

Processing Data with the Peer-Vector Machine 

[55] In genera!, the peer-vector machine 40 effectively divides the 

processing of raw data between the host processor 42 and the pipeline accelerator 
44. For example, the host processor 42 may perform most or all of the 
decision-making operations related to the data, and the accelerator 44 may perform 
most or ali of the mathematicaliy intensive operations on the data. However, the 
machine 40 can divide the data processing In any desired manner. 

Operation of the Host Processor 

[56] !n one embodiment, the host processor 42 receives the raw data from 

and provides the resulting processed data to a remote device sudh as a sonar array 
(FIG. 5), 

[57] The host processor 42 first receives the raw data from the remote 

device via the input port 54 or the bus 50. The peer-vector machine 40 may include 
a FIFO (not shown) for bufferirig the received raw data. 

[583 Next, the processing unit 62 prepares the raw data for processing by 

the pipeline acce!arator 44, For example, the unit 62 may determine, e.g., which of 
the raw data to send to the acceierator 44 or In which sequence to send the raw 
data. Or, the unit 62 may process the raw data to generate intennediate data for 
sending to the accelerator 44. The preparation of the raw data is further discussed 
in previously cited U,S, Patent App. Serial No. 10/684,053 entitled COMPUTING 
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MACHINE HAVING IMPROVED COMPUTING ARCHITECTURE AND RELATED 
SYSTEM AND METHOD. 

[59] While preparing the raw data, the processing unit 54 may also 

generate one or more "soft-configuration" commands to modify the functioning of the 
accelerator 44. Unlike the firmware that configures the Interconnection layout of the 
accelerator 44 when the machine 40 is activated, a soft-configuration command 
controls the ftinctioning of the accelerator without altering its interconnection layout. 
For example, a soft-configuration command may control ti\e size of the data strings 
{e.g., 32 bits or 64 bits) that the accelerator 44 pnocesses. Soft configuration of the 
accelerator 44 is discussed further in previously cited U.S. Patent App. Serial No. 
10/683.929 entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTjNG 
ARCHITECTURE AND RELATED SYSTEM AND METHOD. 

[60] The processing unit 62 then loads the prepared data and/or soft- 

configuration command{s) into a corresponding iocation of the interface memory 48, 
which acts as a FIFO buffer between the unit 62 and the accelerator 44, 

[61] Next, the message handler 64 retrieves the prepared data and/or 

software command{s) from t>e interface memory 48 and generates message objects 
that include the data and/or command(s) and related information, Typicaliy, the 
accelerator 44 needs four identifiers that describe the data/command(s) and tie 
related information (collectively "information"): a) the information's intended 
destination {e.g., the pipeline 74i}, b) the priority (e.g., should the accelerator 
process this data before or after previously received data), c) the length or the end of 
the message object, and d) the unique instance of the data (e.g., sensor signal 
number nine from an array of one thousand sensors). To faciiitate this 
determination, the message handier 64 generates message objects that have a 
predetermined format as discussed above. In addition to the prepared 
data/sofl-configu ration command{s), a message object typically includes a h^der 
that Includes the four above-descnbed identifiers and that may al^ include 
identifiers that describe the type of Information that object Includes (e.g., data, 
command), and the algorithm by which the data is to be processed. This latter 
identifier Is useful where the destination pipeline 74 implements multiple algorithms. 
The handler 64 may retrieve the header information from the interface memory 48, or 
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may generate the header based on the location within the interface memofy from 
which it retrieves the prepared data or commarid{s). By deciphering the message 
header, the router $1 and/or the accelerator 44 can direct the information within the 
message object to the desired destination, and cause that destination to process the 
information in a desired sequence. 

£62] Alternative embodiments for generating the message objects exist. For 

example, although each message object Is described as including either data or a 
soft-configuration command, a singie message object may inciude both data and one 
or more commands. Furthermore, although the message handler 64 Is described as 
receiving the data and commands from the interface memory 48, it may receive the 
data and commands directiy from the processing unit 54. 

[63] The generation of massage objects is discussed further In previously 

cited U.S. Patent App, Serial No. 10/684.053 entitled COMPUTING MACHINE 
HAVING fMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM 
AND METHOD. 

Pipeline Accelerator 

[64] The pipeline acceierator 44 receives and deciphers the message 

Dbjects from the message handier $4 and effectively directs the data and/or 
commands within the objects to the desired destination(s). This technique is 
particularly usefui where the number of afgorithms implemented by the processing 
unit 62 and the pipelines 74 are relatively smalf, and thus the router 61 can be 
omitted, Alternativeiy, where the number of afgorithms imptemenfed by the 
processing unit 62 or the number pipelines 74 is relatively large, the router 61 
receives and deciphers the message ob|ects from tfie message handler 64 and 
effectively directs the data and/or commands within the objects to the desired 
destination(s) within the accelerator 44- 

165] In one embodiment where there are small numbers of processing-unit 

algorithms and pipeffnes 74, each pipeline simultaneously receives a message 
object and analyzes the header to determine whether or not it is an intended 
recipient of the message. !f the message object is intended for a particular pipeline 
74, then that pipeline deciphers the message and processes the recovered 
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data/command{s). If, however, iJie message ob|ect Is not intended for a particular 
pipeline 74, then that pipeline ignores the message object. For exampie. suppose a 
message object includes data for processing by the pipeline 74i. Therefore, the 
plpeiine 74i analyzes the message header, determines that it is an intended 
destination for the data, recovers the data from the message, and processes the 
recovered data. Conversely, each of the pipelines 742~74„ analyzes the message 
header, determines that it is not an intended destination for the data, and thus does 
not recover or process the data. If the data within the message object is intended for 
multiple pipelines 74, then the message handier 64 generates and sends a 
sequence of respective message objects that include the same data, on© message 
for each destination pipeline. Mematively, the message handler 64 may 
simultaneously send the data to all of the destination pipelines 74 by sending a 
single message object having a header that Identifies all of the destination pipelines. 
Recovering data and soft-configuration commands from message objects Is 
discussed further in previously cited U.S. Patent App. Serial No, 10/683.929 entitled 
PIPELINE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD. 

E66J In another embodiment where there are large numbers of 

processing-unit processes or pipelines 74, each pipeline receives message objects 
from the router 61. Although the router $1 should ideally send message objects only 
to the target plpeiine 74, the target pipeline still analyzes the header to determine 
whether or not It is an intended recipient of the message. Such an analysis identifies 
potential message routing errors, /.©,, exceptions. If the message object Is intended 
for target pipeline 74, then that pipeline deciphers the message and processes the 
recovered data/command(s). If, however, the message object Is not intended for the 
target pipeline 74, then that pipeline Ignores the processing for that message object, 
and may also issue a new message to the host processor 42 Indicating that a routing 
exception has occurmd. Handling of routing exceptions Is discussed in previously 
cited U.S. Patent App. Serial No. 10/;684,053 entitled COMPUTING MACHINE 
HAVING IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM 
AND METHOD. 
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[67] Next, the pIpeSme aoceterator 44 processes the incoming data and/or 

commands recovered from the message objects. 

[68] For data, the destination pipeline or pipelines 74 perform a raspectfve 

operation or operations on the data. As discussed in conjunction with FIG. 2, 
because the pipefines 74 do not execute program instructions, they can often 
process the data at a rate that is substantially the same as the frequency of the 
pipeiine cfock> 

[69] \n a first embodiment, a single pipeline 74 generates resulting data by 

pracessing the incoming data, 

|70] In a second embodiment multipie pipelines 74 generate resulting data 

by serially pracessing the incoming data. For example, the pipeline 74 may generate 
first intermediate data by performing a finst operation on the incoming data. Next, the 
pipeiine 74^ may generate second intermediate data by performing a second 
operation on the first intermediate data, and so on, until the final pipeiine 74 in the 
chain generates the result data> 

[71] !n a third embodiment, multiple pipelines 74 generate the resulting data 

by processing the incoming data in parallei. For example, the pipeiine 74i may 
generate a first set of resulting data by performing a first operation on a first set of 
the incoming data. At the same time, the pipeiine 74^ may generate a second set of 
resulting data by perfoiming a second operation on a second set of the incoming 
data, and so on, 

[72| Aitematively, the pipelines 74 may generate resulting data from the 

mcoming data according to any combination of the above three embodiments. For 
example, the pipeline 74i may generate a first set of resulting data by performing a 
first operation on a first set of the incoming data. At the same time, the pipelines 74^ 
and 74n may generate a second set of resulting data by seriafly performing second 
and third operations on a second set of the incoming data, 

[73J In any of the above embodiments and alternatives, a single pipeiine 74 

may perform multiple operations. For example, the pipeiine 74i may receive data, 
generate first intermediate data by performing a first operation on the received data, 
temporariiy store the first intermediated data, generate second intermediate data by 

18 



wo 20iN/<>42560 



FCr/US2WM)34557 



performing a second operation on the first intermediate data, and so on, until it 
generates result data There are a number of techniques for causing the pipeime 74i 
to switch from performmg the first operation to performing the second operation, and 
so on. Such techniques are discussed in previously cited U,S> Patent App. Serial 
No- 10/683.929 entitied PIPELINE ACCELERATOR FOR IMPROVED COMPUTiNG 
ARCHITECTURE AND RELATED SYSTEM AND W ETHOD {Attorney Docket No. 
1934-13^3). 

|74] For a soft-configuration command, the acceierator 44 sets the bits in 

the corresponding soft-conffgyratlon register's) (not shown) as indicated by the 
message header. As discussed above, setting these bits typically changes the 
ftjnctioning of the accelerator 44 without changing its interconnection layout. This is 
similar to setting bits in a control register of a processor for, e.g., setting an externa! 
pin as an input pin or an output pin or selecting an addressing mode. Furthermore, a 
soft-configuration command can partition a register or table (an array of registers) for 
holding data. Another soft-configuration command or an operation performed by the 
aGceierator 44 may ioad data into the soft-configured register or table. Soft 
configuration of the acceierator 44 is discussed further in previously cited U.S. 
Patent App. Sena! No. 10/683.929 entitled PIPELINE ACCELERATOR FOR 
IMPROVED COyPUTlNG ARCHITECTURE AND RELATED SYSTEy AND 
METHOD (Attorney Docket No. 1934-13-3). 

C75J Next the pipeiine accelerator 44 provides the resufting data to the host 

processor 42 via the router 6f (or directiy if the router is omitted) for further 
processing. 

[763 AlternatJveiy, the acceierator 44 provides the resuiting data to the 

remote destination (FIG. 5) either directly via the output port 60, or indirectly via the 
router 61 (if present), the bus 50, the host processor 42, and the output port SB. 
Consequently, in this aiternative embodiment, the resulting data generated by the 
acceierator 44 Is the final processed data. 

£77] When the accelerator 44 provides the resulting data to the host 

processor 42 — either for fijrther processing or for pass through to the remote device 
(FIG. 5) — it sends this data in a message object that has the same format as the 
message objects generated by the message handier 64. Like the message objects 
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generated by the message handler 64, the message objects generated by the 
accelerator 44 include headers that specify, e.g.. the destination and the priority of 
the resulting data. For example, the header may instaict the message handier 64 to 
pass through the resulting data to the remote device via the port 58, or may specify 
which portion of the program executed by the processing unit 62 Is to control the 
processing of the data. By using the same message fomiat, the accelerator 44 has 
the same interface layer as the host processor 42, This facilitates designing and 
modifying the peer-vector machine 40, particularly if the interface layer is an industry 
standard. 

[78} The structure and operation of the pipeline accelerator 44 and the 

pipelines 86 are discussed further in previously cited U.S. Patent App. Serial No. 
10/683,929 entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD (Attorney Docket No. 
1934-13-3). 

Receiving And Pro cesslno From the Pipeline Acceierator With the Host 

Processor 

C79| When It receives a message object from the accelerator 44, the 

message handler 64 first deciphers the message header and directs the recovered 
data to the indicated destination. 

ISO} if the header indicates that the data Is to be passed to the remote 

device (FIG. 5) via the port 58, then the message handler 64 may provide the data 
directly to the port 58, or to a port FIFO buffer (not shown) fomied In the Interlace 
memory 48 or in another memory and then from the buffer to the port S8, Multiple 
pcMts 58 and multiple respective remote devices are also contemplated. 

^1] If, however, the header Indicates that the processing unit 62 is to 

further process the data, then the message handier 62 stores the data in a location 
of the interface memory 48 that corresponds to the portion of the processing-unit 
program that is to control the processing of the data. More specffically, the same 
header now indirectly Indicates which portion(3) of the program executed by the 
processing unit 54 is(are) to control the processing of the data. Consequently, the 
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message handler 64 stores the data In the location (such as a FfFO) of the interface 
memory 48 corresponding to this program portion. 

C82] As discussed above, the interface memory 48 acts as a buffer between 

the accelerator 44 and the processing unit 62, and thus allows the transfer of data 
when the processing unit is not synchronized to the accelerator. For example, Itits 
lack of synchronization may occur wh^ the accelerator 44 processes data faster 
than the processing unit 62. By using the interface memory 48, the accelerator 44 Is 
not slowed by the slower response of the processing unit 62. This also avoids the 
inefficiency penalties associated with the processing unit's Indet^minate response 
time to handling tnten-upts. The indetenninate handling by the processing unit 62 of 
the accelerator 44 output messages would unnecessarily complicate the 
accelerator's design by forcing the designer to provide either: a) storage and 
handling for the backed up output messages, or b) idling controls throughout the 
pipeline to prevent the backed up messages from being ovenwritten. Therefore, the 
use of interface memory 48, which acts as a buffer between the accelerator 44 and 
the processing unit 62, has several desirable consequences a) accelerators are 
easier to design, b) accelerators need iess infrastructure and can hold larger PLIC 
applications, c) accelerators can be streamlined to run faster because output data is 
not "blocked" by a slower processor. 

[83] Then, for data that the message handler 64 has stored in the interface 

memory 48, the processing unit 62 retrieves the data from the interface memory. 
The processing unit 62 may poll the interface memory 48 to determine when new 
data has anived In a particular location,.or the message handler 64 may generate an 
interrupt or other signal that notifies the processing unit of the data's arrivai. In one 
embodiment, before the processing unit 62 retrieves data, the message handler 64 
generates a message object that inciudes the data. More specifically, one may 
design the program executed by the processing unit 62 to receive data in message 
objects. The message handier 64, therefore, could store a message object in the 
interface memory 48 instead of storing only the data. But a message object typically 
occupies significantly more memory space than does the data it contains. 
Consequently, to save memory, the message handler 64 dedphers a message 
object from the pipeline accelerator 44, stores the data in the memory 48, and then 
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efTactlveiy regenerates the message object when the processing unit 62 is ready to 
receive the data. Then, the processing unit 62 deciphers the massage object and 
processes the data y nder the control of the program portion identified in the 
message header, 

|84] Next, the prooessor unit 62 processes the retrieved data under the 

control of the destination portion of the program, generates processed data, and 
stores the processed data in a bcation of the interface memory 48 that corresponds 
to the intended destination of the processed data* 

[85] Then, the message handler 64 retrieves the processed data and 

provides it to the indicated destination. To retrieve the processed data, the message 
handier 64 may poll the memory 48 to determine when the data has arrived, or the 
pnocessing unit 62 may notify the message handler of the data^s arrival with an 
interrupt or other slgnaL To provide the processed data to its intended destination, 
the message handier 64 may generate a message object that includes the data, and 
send the message object back to the accelerator 44 for Hirther processing of the 
data. Or, the handler 56 may send the data to the port SB, or to another location of 
the memory 48 for further processing by the processing unit 62. 

[86| The host processor's receiving and processing of data from the 

pipeline accelerator 44 is discussed further m previously cited U.S, Patent App. 
Serial No. 10/684,053 entitled COMPUTING MACHfNE HAVING IMPROVED 
COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD {Attorney 
Docket No, 1934-12-3). 

Alternative Data Processing TochnSques Using the Peer-Vector Machine 

[873 Stiff referring to FIG. 3, there exist aiternatives to the above-described 

ambodiments in which the host processor 44 recaivas and processes data, and then 
sends the data to the pipeline accelerator 44 for further processing. 

[88] In one alternative, the host processor 44 perfomns ail of the processing 

on at least some of the data, and thus does not send this data to the pipeline 
accelerator 44 for further processing, 

[893 Jn another alternative, the pipeiine acceferator 44 receives the raw data 

directiy from the remote device (FIG, 5) via the port 56 and processes the raw data. 
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The acceJerator 44 may then send the processed data directly back to the mmote 
device via the port 60, or may send the processed data to the host processor 42 for 
further processing, in the latter case, the accelerator 44 may encapsulate the data in 
message objects as discussed above, 

fOOl In yet another alternative, the accelerator 44 may Include, in addition to 

the hardwired pipelines 74, one or more ristruction-executing processors, such as a 
Digital Signal Processor (DSP), to complement the number-crunching abilities of the 
pipelines, 

Exampte tmplementation of the Peer-Vector Machhte 

[911 Still referring to FIG. 3, in one embodiment, the pipeline bus 50 is a 

standard 133 MHz PCI bus, the pipelines 74 are included on one or more standard 
PMC cards, and the memory 52 is one or fiash memories that are each located on a 
respective PMC card. 

Example Application of the Peer-Vector Machine 

[92J FIG. 4 is a block diagram of a sonar system BO that incorporates the 

peer-vector machine 40 of FIG. 3 according to an embodiment of the inven^on. In 
addition to the machine 40, the system BO includes an anray 82 of transducer 
elements 841- B4„ for receiving and transmitting sonar signals, dfeftal-to-anaiog 
converters (DACs) 86? - 8&n, ana!og-to-dlgita! converters (ADCs) 8Sf - 88„. and a 
data interface 90. Because generating and processing sonar signals are often 
mattematically intensive functions, ttie machine 40 can often perform tiese 
ftjnctions more quickly and efficiently than a conventional computing machine — 
such as the multi-processor machine 10 (FIG. 1) — can for a given clock frequency 
as discatssed above In conjunction w^th FrG. 3. 

i;933 During a transmit mode of operation, the array 82 transmits a sonar 

signal into a medium such as water (not shown). First, the peer-vectesr machine 40 
converts raw signal data received on a port 92 into n digital signals, one for eac^ of 
the array elements 84. The magnitudes and phases of Uiese signals dictate the 
transmission-beam pattern of the array 82. Next, the machine 40 provides these 
digital signafs to the interface 90, wrfiich provides tfiese signals to the respective 
DACs 86 for conversion into respective analog signafs. For example, the interface 
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90 may act as a buffer that serially receives the digital signals from the machine 40, 
stores these signals until it receives and buffei^ a!! n of them, and than 
simuitaneousty provides these sequential signai samples to the respective DACs 86* 
Then, the transducer elements B4 convert these analog signals into respective 
soundwaves, which interfere with one another to fomi the beams of a sonar signai. 

[94| During a receive mode of operation, the array 82 receives a sonar 

signal from the medium (not shown). The received sonar signal Is composed of the 
portion of the transmitted sonar signal ttiat is reflected by remote objects and the 
sound energy emitted by the environment and the remote objects. First, the 
transducer elements 84 receive respecttve soundwaves that compose the sonar 
signal, convert these soundwaves into n analog signafs, and provide these analog 
signals to the ADCs 88 for conversion into n respective dtgita! signals. Next, the 
interface 90 provides these dlgita! signafs to the peer-vector machine 40 for 
processing. For exampfe, the interface 90 may act as a buffer that receives the 
digitat signals from the ADCs 88 in paralfef and then serially provides these signats 
to the machine 40. The processing that the machine 40 performs on the digital 
signals dictates the receive-beam pattern of the array 82. Additional processing 
Steps such as filtering, band shifting, spectra! transformation {e.g., the Fourier 
Tmnsfbrm), and convolution are applied to the digitai signals. The machine 40 then 
provides the processed signal data via a port 94 to another apparatus such as a 
display device for viewing located objects. 

|95] Although discussed In conjunction with the sonar system 80, systems 

other than sonar systems may also incorporate the peer-vector machine 40. 

|96] The preceding discusaion is presented to enable a person skilled in the 

art to make and use the invention. Various modifications to the embodiments will be 
readily apparent to those skilled in the art, and the generic principles herein may be 
applied to other embodiments and appiications without departing from the spirit and 
scope of the present invention. Thus, the present invention is not intended to be 
limited to the embodiments shown, but is to be accorded the widest scope consistent 
with the prindpfes and features disclosed herein. 
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WHAT IS CLAiyED IB: 

1 . A pear-vector machine, comprising: 

a host processor operable to execute a program^ and, in response to the 
program, operable to generate first host data; and 

a pipeline accaterator coupled to the host processor and operable to receive 
the first host data and to generate first pipeline data from the first host data. 

2. The peer-vector machine of claim 1 wherein the host processor is 
further operable to: 

receive second data; and 

generate the first host data frofn the second data. 

3. The peer-vector machine of claim 1 wherein the host pracessor is 
further operable to: 

receive the first pipeline data from the pipeline accelerator; and 
process the first pipeHne data. 

4. The peer-vector machine of ciaim 1 wherein the host processor is 
further operabte to: 

receive the first pipaiine data from the pipeline accelerator; and 
generate the first host data from the first pipeline data. 

5. The peer-vector machine of dafm 1 , further comprising: 

an interface memory coupled to the host processor and to the pipeline 
accelerator and having a first memory section; 
v^herein the host processor is operable to, 

store the first host data In the first memory section, and 

provide the first host data from the first memory section to the pipeline 

accelerator. 

6. The peer-vector machine of ciaim 1 , further comprising; 

an interface memory coupled to the host processor and to the pipeline 
accelerator and having first and second memory sections; 
wherein the host processor is operable to, 

store the first host data In the first memory section, 
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provide the first hoet data from the first memory section to the ptpeiine 
accelerator, 

receive the first pipefine data from the pipeHne accelerator, 

store the first pipeline data in the second memory section, 
retneve the first pipeiine data from the second memory section to the 
host processor, and 

process the first pipeline data, 

7, The peer-vector machine of claim 1 wherein the host processor Is 
operable to configure the pipeline acceterator. 

8. The peer-vector machine of claim 1 wherein the plpeOne acceierator 
comprises e pfogrammabte-logic integmted circuit. 

9, A peer-vector machine, comprising: 

a pipeline accelerator operable to generate first pipeline data; and 

a host processor coupled to the pipeiine acceierator and operable to execute 

a program and, in response to the program, operable to receive the first pipeiine data 

and to generate first host data from the first pipeline data, 

10. The peer-vector machine of claim 9 wherein the pipeline accelerator is 
further oparabte to: 

receive second data; and 

generate the first pipeline data from the second data. 

1 1 • The peer-vector machine of claim 9 wherein the pipeiine accelerator is 
further operable to: 

receive the first host data from the host processor; and 
process the first host data> 

1 2, The peer^vector machine of claim 9 wherein the pipeline accejerator is 
further oparabfa to: 

receive the first host data from the host processor; and 
generate the first pipeline data from the first host data. 

13, The peer-vector machine of daim 9, further comprising: 

an interface memory coupled to the pipeline accelerator and to the host 
processor and having a first memory section; and 
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wherein the host processor is operabie to, 

store the first pipeOne data from the pipeline accelerator in the first 
memory section, and 

retrieve the first pipeline data from the first memory section, 

14. The peer-vector machine of claim 9, further comprising: 

an interface memory coupied to the pipeline accelerator and to the host 
processor and having first and second memory sections; 
wherein the host processor is operabie to, 

store the first pipeline data from the pipeline accelerator in the first 
memoiy section, 

retrieve the first pipeline data from the first section, 
store tlie first host data m the second memory section, and 
provide the first host data from the second memory section to the 
pipaline accelerator; and 

wherein the pipeline accelerator is operable to process the first host data 
received from the second memory section. 

1 5. The peer^vector machine of claim 9 wherein the host processor is 
operable to configyre the pipeline accelerator. 

16. A system, comprising: 

a device operabie to generate raw data; 

a host processor coupled to the device and operable to execute a program, 
and, in response to the program, operabie to generate host data from the raw data; 
and 

a pipeline accelerator coupled to the host processor and operable to receive 
the host data and to generate pipeline data from the host data. 

1 7. A system, comprising: 

a device operabie to generate raw data; 

a pipeline accelerator coupied to the device and operable to generate pipeline 
data from the raw data; and 
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a host processor coupled to tlia pipeMne acceierator and operabte to execute 
a program and, In response to the program, operabie to receive the pipeBne data 
and to generate host data from the pipaiina data. 

1 8, A method, comprising: 

generating first host data by executing a program with a host processor; and 
generating first pipeline data from the first host data with a pipeline 
accelerator. 

1 9, The method of daim 1 B, further comprising: 

receiving raw data; 

wherein generating the first host data comprises generating the first host data 
from the raw datac 

20, The method of daim 18 wherein generating the first host data 
comprises generating the first host data from the first pipeline data. 

21 , The method of claim 18, further comprising generating second host 
data from the first pipeHoe data by executing the program with the host processor. 

22, The method of daim 18, further comprising configuring the pipeline 
accelerator by executing the program with the host processor. 

23, A method, comprising: 

generating first pipeline data with a pipaiine accelerator; and 
generating first host data from the first pipeline data by execyting a program 
with a host processor. 

24, The method of daim 23, further comprising: 
receiving raw data; 

wherein generating the first pfpefine data comprises generating the first 
pipetine data from the raw data. 

25* The method of daim 23 wherein generating the first pipefine data 
comprises generating the first pipeline data from the first host data. 

26. The method of claim 23, further comprising generating second pipeline 
data from the first host data with the pipeline accelerator. 
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27. The method of ciaim 23. further comprising configuring the ptpeiine 
accelerator by exec^iting the program with the host processor. 



29 



wo 2004/042560 



.PCT/ljS2W3/034557 




SUBSTITUTE SHEET (RULE 26) 



wo 2004/042560 



PCT/US2(M)3/t}34557 




CM 



o 
CO 



SUBSTiTUTE SHEET (RULE 26) 



wo 20*14/042560 



PCT/US2003/034557 



1. 









2: 



















3/4 



SUBSTITUTE SHEET (RULE 26) 



wo 2004/042560 



PCT/US2003/0345S7 



^ LU Hr 
< CO 3 
S to O 

Q ^ <r 
H- O p 

£L O < 
O Q^Ot 




4/4 

SUBSTITUTE SHEET {RULE 26) 



